A novel ensemble pruning algorithm based on randomized greedy selective strategy and ballot
نویسنده
چکیده
Although the Directed Hill Climbing Ensemble Pruning (DHCEP) algorithm has achieved favorable classification performance, it often yields suboptimal solutions to the ensemble pruning problem, due to its limited exploration within the whole solution space, which inspires us with the development of a novel Ensemble Pruning algorithm based on Randomized Greedy Selective Strategy and Ballot (RGSS&BEP), where randomization technique is introduced into the procedure of greedy ensemble pruning, and the final pruned ensemble is generated by ballot, which are the two major contributions of this paper. Experimental results, including t-tests on the three benchmark classification tasks, verified the validity of the proposed RGSS&B-EP algorithm. & 2013 Elsevier B.V. All rights reserved.
منابع مشابه
Microsoft Word - Dr. Li (0795)_TOCSJ.docx
At first the thesis introduces a new concept: coverage-based pattern mining. Then based on this concept, two ensemble pruning algorithms, CPM-EP and PMEP are put forward. By the algorithms we get candidate sub-patterns,and applies coverage pattern mining and a greedy strategy to acquire candidate target ensemble. Experiments show that pattern mining is an efficient selective integration strateg...
متن کاملPruning variable selection ensembles
In the context of variable selection, ensemble learning has gained increasing interest due to its great potential to improve selection accuracy and to reduce false discovery rate. A novel ordering-based selective ensemble learning strategy is designed in this paper to obtain smaller but more accurate ensembles. In particular, a greedy sorting strategy is proposed to rearrange the order by which...
متن کاملAn efficient ensemble pruning algorithm using One-Path and Two-Trips searching approach
Keywords: Ensemble pruning Backtracking algorithm Ensemble Pruning via BackTracking algorithm (EnPBT) One-Path and Two-Trips searching algorithm (OPTT) Pruning efficiency a b s t r a c t Ensemble pruning is substantial for the successful application of an ensemble system. A novel method for Ensemble Pruning via BackTracking algorithm (EnPBT) was proposed by us in our previous work. Back-trackin...
متن کاملA Study on Greedy Algorithms for Ensemble Pruning
Ensemble selection deals with the reduction of an ensemble of predictive models in order to improve its efficiency and predictive performance. A number of ensemble selection methods that are based on greedy search of the space of all possible ensemble subsets have recently been proposed. They use different directions for searching this space and different measures for evaluating the available a...
متن کاملEnsemble Pruning Via Semi-definite Programming
An ensemble is a group of learning models that jointly solve a problem. However, the ensembles generated by existing techniques are sometimes unnecessarily large, which can lead to extra memory usage, computational costs, and occasional decreases in effectiveness. The purpose of ensemble pruning is to search for a good subset of ensemble members that performs as well as, or better than, the ori...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Neurocomputing
دوره 122 شماره
صفحات -
تاریخ انتشار 2013